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(57) Abstract 



A method of distinguishing from "true" video, video material which was originated on film video or, more generally, detecting the 
residual effect of a past conversion from a lower temporal sampling rate involving the repetition of images, involves measuring a motion 
parameter such as a field averaged motion vector magnitude. A difference value is taken from successive motion parameters; this is 
subtracted from the motion parameter and the results of said comparison are accumulated. A trend of positive results is indicative of "true" 
video and a trend of zero or negative results suggests image repetition. 
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VIDEO SIGNAL PROCESSING 

This invention relates to video signal processing. 
It is well known that a variety of video processes which are optimised 
for video material having a particular temporal sampling rate, can function 
differently - and usually less well - with video material transferred from film 
5 or converted in some other way from an original temporal sampling rate 
which was lower. If the origins of the video material which is to be 
processed are known, the process can be appropriately optimised at the 
outset. A difficulty arises where the origins of the material are unknown or 
where the video material is a compilation of material having different origins. 
10 Video material which originated from film (whether 24 Hz, 25 Hz or 30 Hz), 
slow motion replays and animation will usually have repeating images which 
will lead to sub-optimal performance in particular video processes, unless 
correctly identified. 

It is an object of the present invention to provide a relatively 
15 straightforward yet reliable method of detecting, in a video signal having a 
particular temporal sampling rate, the residual effect of a past conversion 
from a lower temporal sampling rate involving the repetition of images. 

Accordingly, the present invention consists in a method of detecting, 
in a video signal having a particular temporal sampling rate, the residual 
20 effect of a past conversion from a lower temporal sampling rate involving the 
repetition of images, comprising the steps of measuring a motion parameter 
between successive images, determining a difference value between 
successive measured motion parameters; comparing the motion parameter 
and difference values and accumulating the results of said comparison. 
25 Preferably, the motion parameter comprises the average magnitude of 

the motion vectors. 

Suitably, the results of the comparison are accumulated by monitoring 
a trend in the sign of the comparison. 

This invention can operate using any of a wide variety of known 
30 techniques -far splitting a picture into blocks and measuring a motion vector 
between these blocks in successive images. The average vector magnitude 
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is calculated from the motion vectors measured between every successive 
image. The magnitude of the temporal differential of the average vector 
magnitude is calculated and this number is subtracted from the average 
vector magnitude. It is to be expected that in "true" video material the 

5 temporal differential of the average vector magnitude will tend to be less 

than the average vector magnitude. The subtraction will therefore generally 
produce a positive result and by noting a trend of positive results, the 
material can be inferred as video originating. 

In the case of material which was originated as film, the average 

10 vector magnitude will switch from a value which is representative of the 

picture content to an artificially low value (theoretically zero) where motion is 
measured between two fields which originate from the same film frame. 
With this variation, the differential of the average vector magnitude will be 
generally high compared to the average vector magnitude itself. 

15 Accordingly, subtracting the differential measurement from the actual 

measurement will produce a zero or negative result and a tendency towards 
negative results will enable detection of film originating material. 

in converting from 24 Hz film to 60 Hz NTSC, it is usual to employ the 
well known 3:2 pulldown sequence. For subsequent video processing, it is 

20 desirable not only to detect the character of the film originating material but 
also to identify the precise phase in the field duplicating and reordering 
sequence that arises from the 3:2 pulldown process. 

Apparatus which detects the phase of the 3:2 pulldown sequence 
already exists and reference is directed for example to WO/91 06182. 

25 Known approaches generally compare fields from successive video frames 
to derive a field difference signal which will be expected to be small in the 
case of duplicate fields added in the 3:2 pulldown. A logic arrangement is 
then provided to identify a repeating pattern in the sequence of field 
difference signals. It is an object of the present invention to provide an 

30 alternative method for identifying the phase of the field duplicating and 

reordering sequence in video material resulting from a 3:2 pulldown process. 
Accordingly, the present invention consists, in a further aspect, in a 
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method for identifying the phase of the field duplicating and reordering 
sequence in video material resulting from a 3:2 pulldown process comprising 
the steps of measuring a motion parameter; storing a sequence of measured 
motion parameters for successive fields; comparing the pattern of motion 

5 parameters with known patterns associated respectively with different 

phases of the field duplicating and reordering sequence and selecting the 
phase providing the closest match. 

The present invention will now be described by way of example with 
referencejo the accompanying drawings in which:- 

10 Figure 1 is a block diagram illustrating apparatus according to one 

aspect of the present invention, for distinguishing between video originated 
and film originated material; 

Figure 2 is a block diagram illustrating apparatus according to a 
further aspect of this invention for identifying the phase of a 3:2 pulldown 

15 sequence and Figure 3 is a block diagram illustrating, in more detail, one 
component of the apparatus of Figure 2. 

Referring initially to Figure 1 , video material passes to a motion 
estimator 10 which generates motion vectors. The motion estimator can 
take a wide variety of known forms with a particularly suitable technique 

20 being that of phase correlation as disclosed, for example, in 

GB-B-2 188 510. The magnitude of the motion vectors derived by the 
motion estimator 10 is calculated in block 12 and these magnitudes are 
averaged for each field in block 14. The field-averaged vector magnitude, 
which can be regarded as a motion parameter for that field, is taken directly 

25 as one input to subtracter 16 and via a field delay 18 to form the other input 
of the subtracter. The output of the subtracter, which is then the difference 
in the motion parameter for successive fields, is then passed through block 
20 which serves to extract the magnitude. A further subtracter 22 takes as 
its positive input, the current motion parameter and as its negative input the 

30 magnitude of the difference signal. 

As has been previously noted, a tendency to positive results in the 
subtracter 22 will be indicative of video originating material whilst a tendency 
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towards negative results will be indicative of film originating material. The 
remainder of the circuit shown in Figure 1 is concerned with identifying these 
tendencies in a manner which is reliable, which responds in a proper manner 
to cuts between film originated and video originated material and which 
5 deals in a sensible manner with picture material having finite but unusually 
low movement. 

Thus, the output of subtracter 22 passes through multiplier 24 
performing a x 16 operation. As will be described subsequently, the choice 
of coefficient for the multiplier affords a degree of sensitivity control for 

10 process. The output of the multiplier 24 passes to block 26 which serves to 
clip the signal in both positive and negative senses. In this case, the 
clipping occurs at ± 5 although, as will be- described! the choice of clip limits 
provides a measure of control over the rate at which apparent changes 
between video originated and film originated material are detected. The clip 

15 signal from block 26 Is accumulated and further clipped in an arrangement 
which comprises an adder 28, a clipper 30 and a field delay 32. The output 
of clipper 26 passes through adder 28 to a further clipper 30 which has a 
clip limit of ± 25. The adder 28 receives as its second input the output of 
the clipper 30 passed through the field delay 32. 

20 In the case of video originating material having constant motion, the 

differential vector magnitude will be zero and, with the gain afforded by 
multiplier 24, the output from clipper 26 will be continuously + 5. It will be 
seen that after 5 cycles, the output of the clipper 30 will reach and will be 
held at the positive clip limit of + 25. In the more normal case in which there 

25 is varying motion, the motion vector differential will be non-zero but 

nonetheless smaller on average than the actual motion vector magnitude. 
The sensitivity provided, by multiplier 24 is selected so that in most cases, 
the output of clipper 26 remains at the positive clip limit so that a rate of 
change of 5 cycles, (from the zero condition) still applies.. In the case of 

30 very small motion with, for example, "talking heads" picture material, the high 
gain of multiplier 24 ensures that information regarding the motion is still 
made use of. The clip limit In block 26 may not be reached and the rate of 
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change of the detector output will therefore be slow. 

In the. case of film originating material, the output from subtracter 22 
will be expected to be zero or negative. In an analogous manner, the first 
clip limit of - 5 and the accumulated clip limit of - 25 will apply and an 
5 output of -25 can be identified with film originating material. It will be noted 
that an output of zero is taken simply to mean "don't know". 

The five-fold relationship between the clip limits of block 26 and 30 
have been selected to govern the delay after which the detector switches 
* between video originating and film originating material in the "ideal" case of 
10 a cut between constant motion film and constant motion video. If a longer 
delay is appropriate, a ten-fold or greater differential between the two clip 
limits can be employed. 

Turning now to Figures 2 and 3, there is shown a further embodiment 
of the present invention which is capable of identifying the phase of the 3:2 
15 sequence in 60 Hz NTSC material originated on film and subjected to a 3:2 
pulldown. Certain components are shared in common with the embodiment 
of Figure 1 . These components have the same reference numerals and will 
not be described in any more detail. 

The output from block 14, which is a motion parameter in the form of 
20 an average motion vector for the field, is taken to a chain of field delays 40- 
46 These feed in turn an array of match filters 50-58, clocked at field rate 
by means of a modulo 5 counter 60. 

Referring now to Figure 3, there is shown in more detail the structure 
of each match filter 50-58. It will be seen that the input to the match filter is 
25 taken to a chain of field delays 70-76 which feed multipliers 80-88. The 
coefficients A. to E supplied to these multipliers, vary in the clock cycle as 
follows:- 
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The output of the multipliers 80-88 are taken through adder 90 which 
generates the output for the match filter. 

Returning to Figure 2, the outputs of the match filters are taken 
■ through respective recursive filters 100-108 which generate the five inputs 
10 for selector 110. The function of this selector is to pick the- largest output 

from the recursive filters 100-108. In the ideal case, only one output will be 
positive. There is preferably hysteresis built into the selector 110 so that 
short term shifts in the ranking of the inputs, arising from noise, are ignored. 
The coefficient sequence of the selected match filter indicates the field 
15 sequence of the input video.- 

It should be understood that this invention has been described by way 
of example and a wide variety of modifications are possible without departing 
from the scope of the invention. Whilst the example has been taken of 3:2 
pulldown, the method of the invention is capable of, more generally, 
20 detecting the residual effect of a past conversion from a lower temporal 
sampling rate involving the repetition of images. 
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CLAIMS 

1. A method of detecting, in a video signal having a particular 'temporal 
sampling rate, the residual effect of a past conversion from a lower temporal 
sampling rate involving the repetition of images, comprising the steps of 

5 measuring a motion parameter between successive images, determining a 
difference value between successive measured motion parameters; 
comparing the motion parameter and difference values and accumulating the 
results of said comparison. 

2. A method according to Claim 1 , wherein the step of measuring a 
10 motion parameter between successive images comprises identifying a 

plurality of motion vectors associated with respective regions of the image 
and taking the average magnitude of the motion vectors. 

3. A method according to Claim 1 or Claim 2, wherein the step of 
accumulating the results of said comparison comprises monitoring a trend in 

15 the sign of the comparison. 

4. Apparatus for detecting, in a video signal having a particular temporal 
sampling rate, the residual effect of a past conversion from- a lower temporal 
sampling rate involving the repetition of images, comprising means for 
measuring a motion parameter between successive images, means for 

20 determining a difference value between successive measured motion 
parameters; means for comparing the motion parameter and difference 
values and means for accumulating the results of said comparison. 

5. Apparatus according to Claim 4, wherein the means for measuring a 
motion parameter between successive images serves to split a picture into 

25 blocks, to measure a motion vector between these blocks in successive 
images and to calculate an average vector magnitude from the motion 
vectors measured between each pair of successive images. 
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6. Apparatus according to Claim 5, wherein said means for comparing 
the motion parameter and difference values serves to subtract the ■ 
magnitude of the temporal differential of the average vector magnitude from 
the average vector magnitude. 

5 7. A method for identifying the phase of the field duplicating and 

reordering sequence in video material resulting from a 3:2 pulldown process, 
comprising the steps of measuring a motion parameter; storing a sequence 
of measured, motion parameters for successive fields; comparing the pattern 
of motion parameters with known patterns associated respectively with 
10 different phases of the field duplicating and reordering sequence and 
selecting the phase providing the closest match. 

8. A method according to Claim 7, wherein the step of measuring a 
motion parameter comprises identifying a plurality of motion vectors 
associated with respective regions of the image and taking the average 

15 magnitude of the motion vectors. 

9. Apparatus for identifying the phase of the field duplicating and 
reordering sequence in video material resulting from a 3:2 pulldown process, 
comprising means for measuring a motion parameter; means for storing a 
sequence of measured motion parameters for successive fields; means for 

20 comparing the pattern of motion parameters with known patterns associated 
respectively with different phases of the field duplicating and reordering 
sequence and means selecting the phase providing the closest match. 

10. Apparatus according to Claim 9, wherein said means for comparing 
the pattern of motion parameters with known patterns associated 

25 respectively with different phases of the field duplicating and reordering 

sequence comprises five match filters receiving said sequence of measured 
motion parameters delayed by one field interval from one match filter to the 
next. 
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